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STANDARDIZED TESTS AND THE IMPROVEMENT OF 
TEACHING IN FIRST- YEAR ALGEBRA 1 



H. O. RUGG 
School of Education, University of Chicago 

AND 

J. R. CLARK 
Parker High School, Chicago 



D. THE FUNCTION OF ALGEBRA TESTS 

Algebra tests may have two functions: (i) they provide a 
yardstick for measuring the results of instruction and for deter- 
mining the relative efficiency of teaching and the progress that 
teachers and pupils are making; (2) their more important function, 
however, is that of diagnosis: they reveal difficulties in learning and 
point out needed changes in teaching emphasis. 



I. MEASURING' THE RESULTS OE INSTRUCTION IN ALGEBRA IN 27 SCHOOL 
SYSTEMS BY MEANS OF THE TESTS 



The formal 


Tests I-XI have been given in the following 27 


school systems: 






Cities in Illinois 


*Rossville 


Marshall *Carbondale Normal School 


Robinson 


*Lincoln Cairo 


Bradley 


*Highland Park *Benton 


Pekin 


*Henry *Watseka 


*Paris 


Gibson City Waukegan 


*Palatine 


*Divernon *Decatur 


*Oak Park 


*Chicago Heights *Joliet 


*Mount Olive 


Charleston High School 


*Mount Carmel 


Charleston Normal School 



Cities Outside Illinois 

Muskogee, Okla. *Mankato, Minn. 

1 A final report on the "Experimental Determination of Standards in First Year 
Algebra," made to the Mathematics Section of the University of Illinois High-School 
Conference, November 24, 1916. Part I appeared in School Review, February, 1017. 
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In those 17 cities marked with an asterisk the verbal tests were 
also given. In addition to these 17 cities the verbal tests were 
also given in the following four schools: 

Crane Technical High School, Chicago 
Parker High School, Chicago 
Englewood High School, Chicago 
Carter Harrison High School, Chicago 

and in four schools which returned papers with no names. The 
number of pupils taking the tests in each school was about 50. 
The total number of pupils solving the formal tests was 1,182; 
the total number solving the verbal tests was 1,295. 

From the detailed records of the results of this testing in 27 
school systems we give in Tables II and III five typical sets of 
scores, namely, that of (1) the best school, (2) average of the upper 
third (9 schools), (3) the ninth school, (4) the average of all the 
schools (27 schools), (5) the lowest school. These five scores on 
each test, both for accuracy ("Rights") and speed ("Attempts"), 
show the range of attainment for representative algebra instruction, 
the best and the poorest attainment and a tentative standard 
(for the formal processes) which we would like to set before teachers 
of algebra. 

The average attainment of the upper third of the 27 schools as the 
tentative standard of attainment in first-year algebra.- — -There have 
been many suggestions of late that the average of the entire group 
be taken as standard practice. We believe that the average of the 
entire group is too low a standard. It is contributed to by many 
schools of a very low instructional efficiency. On the other hand, 
in finding the average of some upper group we set a standard con- 
tributed to only by schools that have maintained a high level of 
instructional efficiency. To take the average of the upper nine 
schools means to discount the best attainment (of the highest 
school, by allowing for possible unusual conditions which might 
lead to the very best score), and yet to set a standard that has 
actually been exceeded by four, five, or six schools. In case any 
teacher wishes to compare her scores with those of the ninth school 
(whose record has been exceeded by eight schools) those scores are 
included here. 
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The tables make clear the striking differences in the speed and 
accuracy with which pupils manipulate different formal opera- 
tions. The very large percentage of "rights" (of the problems 

TABLE II 

Efficiency in First- Year Algebra (Rights) 

Norms of attainment in eleven formal operations as determined by: (1) attain- 
ment of the most efficient school, (2) average attainment of the upper third of 27 
schools, (3) attainment of the ninth school (i.e., the lowest school of the upper third)i 
(4) average attainment of 27 schools, (5) attainment of the lowest of 27 schools. 





Number of Problems Worked Correctly per Minute 




Test I 


Test II 


Test III 


Test IV 


TestV 


Test VI 


Score of most efficient 
school 


13 js 


5-39 


3-24 


4-°5 


1.42 


11.84 






Average of scores of upper 
third of 27 schools 


10 -95 


4-79 


2-73 


3-5° 


O.84 


10.66 


Score of ninth school 


9-97 


4.40 
(18 schc 


2-44 
ols were be; 


2-94 
ow this atta 


. °S3 

inment) 


9-85 


Average of 27 schools was 


90S 


3.8l 


2.20 


2.8s 


°-54 


9.19 


Score of poorest school was 


6.12 


2. is 


1.23 


I. 71 


0.17 


4.28 




Test VII 


Test VIII 


Test IX 


TestX 


Test XI 


Score of most efficient 
school 


2-7S 


1-97* 


5.28 


2.76 


0.86 






Average of scores of upper 
third of 27 schools .... 


2.02 


4.16* 


3-9 1 


1.60 


0-73 


Score of ninth school 


i-73 


5-92* 
(18 schc 


ols were be 


1. 19 

ow this atta 


0.62 
inment) 


Average of 27 schools 


i-37 


7.91* 


2.76 


I.09 


O.63 


Score of poorest school. . . . 


o-Si 


1.97* 


O.I2 


O.IO 


0.2s 



* Minutes required to solve one problem. 



attempted), together with the large number of problems worked 
per minute in the case of Tests I and VI, lead to the conclusion 
that present methods of instruction in the removal of parentheses and 
in the use of exponents leads to satisfactory automatism of these 
operations. Pupils have reduced the manipulation of the paren- 
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thesis to a high state of efficiency. Even in the case of exponents, 
however, 15 per cent of errors are made on the average. 

On the other hand, the score of the poorest school was but 
slightly more than half that of the average of the upper nine. In 

TABLE III 

Speed in Working Formal Problems (as Shown by Number 
op Problems Attempted) 

Norms of attainment in eleven formal operations as determined by: (1) attain- 
ment of the most efficient school, (2) average attainment of the upper third of 27 
schools, (3) attainment of the ninth school, i.e., the lowest school of the upper third, 
(4) average attainment of 27 schools, (5) attainment of the lowest of 27 schools. 





Number of Problems Worked Correctly per Minute 




Test I 


Test II 


Test III 


Test IV 


TestV 


Test VI 


Score of most efficient 
school 


14-54 


6.26 


4- 23 


4-57 


3.00 


13-30 




Average of scores of upper 
third of 27 schools 


"•59 


5-8o 


3-5° 


4.14 


I-5I 


12.46 




10.68 


5-5i 
(18 schc 


3 24 
>ols were be 


3.87 
ow this atta 


1. 16 

inment) 


II. 51 


Average of 27 schools 


10.36 


4-94 


3.02 


3 OO 


1. 14 


II. 16 


Score of poorest school. . . . 


6.50 


2.82 


2.20 


2.40 


0.49 


7.91 




Test VII 


Test VIII 


Test IX 


TestX 


Test XI 


Score of most efficient 
school 


3-47 


1.44* 


7.27 


4.19 


I 08 






Average of scores of upper 
third of 27 schools 


2.88 


2.50* 


5-8o 


3-23 


O.05 


Score of ninth school 


2.63 


3-87* 

(18 schc 


,5-23 

tols were be. 


2.82 
ow this atta 


O.83 

inment) 


Average of 27 schools 


2-35 


3 °5* 


4-85 


2.71 


0.81 


Score of poorest school. . . . 


1.40 


i-44* 


2.88 


1.48 


O.47 



* Minutes required to do one problem. 



fact, in all remaining tests, the score of the poorest school is less 
than half that of the average of the upper third. In some it is 
only one-fifth to one-sixth of the standard score. Such low levels, 
combined as they generally are with low efficiency in "translation" 
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processes (see Table III), certainly call for closer supervision of 
instruction. As pointed out in last year's report, they indicate, in 
some cases at least, a lack of teaching emphasis on certain operations 
with a corresponding greater emphasis on others. This question of 
teaching emphasis in the case of very good and very poor schools 
is further illuminated by tracing the record of individual schools 
in each of the different operations. If this is done, it will be found 
that the three poorest schools fall in the lowest third in all but 2 
tests. The two best schools fall in the upper third in all but 2 of 
the 11 tests. 

The scores for all remaining tests (except Tests I, II, and VI) 
point out definite lack in making automatic a skill necessary to 
success in using algebraic methods in original solution. Note, 
for example, the original scores for Test V, fractions; Test VII, 
quadratics; Test VIII, graphs; Test IX, radicals; Test X, prac- 
tical formulae; Test XI, simultaneous equations. The upper 
group in each case shows what may be regarded as a fair degree 
of speed, but almost universally shows a woeful lack of accuracy. 
We believe that instruction in these operations should lead to auto- 
matic efficiency. Under such a condition recurring mistakes in a 
class would be impossible, accidental mistakes would occur, but be 
very rare (e.g., mistakes in reading, writing, and rare mistakes in 
arithmetic). The test at least reveals the results of instruction in 
these processes. 

2. THE RELATION BETWEEN EFFICIENCY IN THE AUTOMATIC PROCESSES AND 
EFFICIENCY IN REASONING PROCESSES 

Teachers and administrators who have been loath to adopt 
"measuring methods" in their school practice and who have hesi- 
tated to introduce practice exercises do so on the ground that such 
a procedure will "mechanize" teaching. This same skepticism 
has been commonly expressed as a result of the 19 15 report on 
algebra — the point of view of the writer and the implications of the 
report certainly having been misunderstood. The 1916 testing 
was, therefore, planned to take account of this question. Seven- 
teen school systems took the eleven formal tests and also the verbal 
or reasoning tests. Table IV gives the comparative ranks of each 
of the 17 schools in both types of test. To permit a composite 
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comparison of ability of the two types, the rank of each of the 
17 schools has been determined for accuracy in each of the eleven 
tests. A tabulation was then made to give the aggregate ranks 
of each school. The list was then reranked, calling the school that 
had the lowest number of aggregate ranks 1, the next lowest 2, 
etc., throughout the list. The final comparison of ranks is shown 
in Table IV. 

TABLE IV 

Comparison of the Rank of 17 Schools in Efficiency in Manipulation of the 

Formal Operations with Rank of Same Schools in 

Efficiency in Reasoning Tests 



School System 


Rank, in Aggregate Scores 
Made in: 


School System 


Rank in Aggregate Scores 
Made in: 




Reasoning Tests 


All Formal Tests 


Reasoning Tests 


All Formal Tests 


A 


1 

9 

11 
16 

14 
10 

2 
7 
5 


1 

9 

S 

16 

10 

13 

3 

8 

12 


it 


3 
8 

4 
13 

6 
12 
IS 
17 


6 


c 


M 




F 


N 


14 


Y 


P 


G 


Q 


4 
7 

17 
r 5 


I 


R 


J 


V 


Z 


W 


K 









The first, ninth, sixteenth, tenth, second, seventh, third, eighth, 
sixth, fifteenth, and seventeenth schools in the "reasoning tests" 
occupy ranks in the "formal tests" equal to these or not displaced 
by more than 3 places in 17. That is, n of the 17 schools stand 
almost in the same relative position in reasoning efficiency as in 
formal efficiency. Of the whole 17 schools only 2 show a distinct 
reversal of position in the two types, schools N and P. In view of 
the preponderance of evidence showing high positive correlation 
between these two types of processes we are unable to account for 
the status of the data on these two schools. Of the remaining 4 
schools, G is displaced four places, R, 5 places, and K, 7 places. 
For those interested in correlations we may say that by Spear- 
man's footrule method (with 17 cases any coefficient has little 
validity, hence we may as well use a rough approximate method as 
the more accurate product-moment method) 7=0.59, which may 
be regarded as a high correlation. 
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Careful study of our complete data leads us to the conviction 
that those teachers who have been most successful in developing 
skill in manipulating the formal processes have also been most 
successful in developing ability to "translate" verbally stated 
problems into algebraic symbolism. We regard this as pertinent 

to the question of "mechanization" of the teaching process 

We believe that it emphasizes the main point we are trying to make: 
namely, that with carefully planned practice periods, using scien- 
tifically built-up practice material, teachers will be still more effec- 
tive in developing "original ability." 

Certainly, without the aid of scientifically planned practice 
devices, teachers who have been most successful in doing the one, 
have been, very generally, most successful in doing the other. We 
have no reason to believe, from our present detailed data, that 
teachers who drill their pupils to a relatively high state of "formal 
efficiency" do so by neglecting the higher thought processes in 
algebraic solution. The teachers, furthermore, have done this 
without the aid of carefully differentiated drill exercises. They 
have followed, in the main, the traditionally planned textbook 
organization of theoretical presentation and "problem exercises." 

We take the position that much greater correlation might come 
about, then, through the aid of carefully designed practice exercises 
which put the chief emphasis in practice upon the difficult processes, 
saving time for more detailed training in those types of solution 
that call for analysis discrimination and other higher thought 
processes. Testing pupils' ability to manipulate algebraic opera- 
tions does not lead to a general blind "mechanization" of the 
teaching process. It leads to an intelligent understanding of what 
operations ought to get the most drill and relatively how much they 
ought to be drilled — in a word, differentiated drill takes the place 
of blind wholesale drill such as will ensue if one follows the textbook 
organization as the sole guide. 

3. THE RELATION BETWEEN SPEED AND ACCURACY IN "FORMAL EFFICIENCY" 

Table V gives the rank of each of the schools in number of 
problems attempted and number right. The high degree of 
relationship between speed (represented by "number of problems 
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Comparison of Speed and Accuracy, as Shown by Rank of 27 Schools in Each 

of 11 Formal Tests in Number of Problems Attempted 

and Number of Problems Right 



School 
System 



Test I 



Test II 



Test III 



Test IV 



Test V 



Rank in No. Problems 



Att. 



Rt. 


Att. 


Rt. 


Att. 


Rt. 


Att. 


Rt. 


Att. 


12 


IS 


13 


2 


I 


17 


8 


s 


3 


3 


3 


20. s 


15 


2 


1 


3 


14 


16 


22 


18.5 


13 


22 


21 


22.5 


4 


13 


11 


6 


4 


4 


5 


10 


13 


27 


27 


22.5 


20 


16 


19 


21 


9S 


7-5 


7 


9 


S 


15 


17 


iS-5 


18 


6 


2 


11 


9 


26 


23 


11 


2 


2 


1 


4 


3 


l8 


11 


27 


27 


9 


10 


3 


2 


8 


13 


7 


8 


75 


5 


12 


12 


7 


6 


1 


22 


25-5 


23 


i«-S 


23 


21 


18 


22.5 


4-5 


11 


8 


s 


6 


1 


2 


18 


24 


12 


17 


25 


26 


14 


15-5 


12 


19 


22 


25 


22.5 


25 


12 


15-5 


17 


25 


25-5 


24 


27 


24 


20 


20 


24 


16 


20 


14 


15 


11 


S 


4 


9 


1 


1 


4 


7 


ia-5 


6 


10 


4 


17 


4 


IS 


16 


18. 5 


11 


14 


2 


6 


S 


6 


14 


7 


3 


3 


IS 


23 


24 


20 


1 


14 


27 


27 


14 


20 


21 


21 


8 


8 


10 


9 


8 


26 


17 


19 


26 


27 


25 


26 


26 


15 


19 


18 


17 


22 


23 


25 


25 


11 


14 


9 


10 


10 


24 


24 


13 


21 


23 


26 


20. s 


21 


19 


22 


19 


5 


10 


12 


11 


17 


9 


12 


20 


7 


18 


16 


24 


16 


13 


7 


6 



Rt. 



A. 
B. 
C. 
D. 
E. 
F. 
G. 
H. 
I. 

J- 
K. 
L. 
M 

N. 
O. 
P. 

Q. 
R. 
S. 
T. 
U. 
V. 
W 
X 
Y. 
Z. 



14 
4 

IS 
2 

17 
12 
20 

S 

27 
88 
22 

7 
23 
10 
26 

19 
1 

18 
6 

25 
16 

24 

13 

9 

21 

3 
11 



S 
3 

14 
9.S 

21 

16 

8 

26 

7 
1 

23 

21 

19 
IS 
21 

4 

6 
12 
11 
18 

9-5 

25 

27 
24 
17 
13 
2 



Test VI 



Test VII 



Test VIII Test DC 



TestX 



Test XI 



Rank in No. Problems 



Att. 


Rt. 


Att. 


Rt. 


Att. 


Rt. 


Att. 


Rt. 


Att. 


Rt. 


Att. 


18 


6 


II 


2 


19 


II 


5 


2 


23 


6 


10 


2 


27 


I 


I 


2 


6 


1 


I 


1 


1 


2 


9 


12 


23 


235 


16 


16 


16 


12 


2 


7-5 


25 


4 


4 


18 


14 


24 


20 


12 


7 


18 


14 


12 


24 


22 


25 


27 


22 


2 


24 


26 


12.5 


15 


23 


IS 


13 


10 


7 


12 


13 


17 


16 


9 


9 


I 


25 


23-5 


27 


2S-S 


26 


22 


23 


14 


21 


18 


20.5 


2t> 


25 


9 


4 


IO 


7 


3 


3 


12.5 


it>-5 


14 


23 


16 


24 


20 


9 


9 


6 


8 


25 


11 


20. s 


b 


8 


7 


13 


5 


5 


11 


10 


6 


ib. 5 


5 


7 


7 


4 


8 


1 


1 


25 


24 


26 


26 


9 


8 


9 


8 


15 


18 


4 


2 


9 


10 


24 


8 



Rt. 



A, 
B 
C 
D 
E 
F. 
G 
H 
I. 

J- 

K 
L 



95 

1 

23 
12 

19-5 

4 
11 

7-5 
18 

7-S 
13 
21 



204 



THE SCHOOL REVIEW 
TABLE V— Continued 





Test VI 


Test VII 


Test VIII 


Test IX 


TestX 


Test XI 


School 
System 


Rank in No. Problems 




Att. 


Rt. 


Att. 


Rt. 


Att. 


Rt. 


Att. 


Rt. 


Att. 


Rt. 


Att. 


Rt. 


M 

N 



P 

Q 

R 

S 

T 

U 

V 


14 
10 

22 

13 
12 

17 
I 
21 
20 
27 
16 
II 
19 

3 
5 


10 
11 

20 

5 
23-5 
14 

3 
21 

15 
26 

19 
18 

17 

2 

1 


5 
20 

19 
16 

3 
15 

2 

13 
17 
26 

21-5 

6 

2I-S 

13-5 
i3S 


17 
10 
18 

5 

6 
12 

3 

9 
16 
21 
22 
11 

23-5 
19 
25-5 


4 
20 

2S 

6 

IS 
8 

13 

243 

14 


12 
15 

23 
IO 

19 

6 
18 

8 
24 


18 
26 
10 
13 
9 
14 
22 

IS 
20 

19 
8 

7 


19 

25 
6 

4 
5 

18 
20 

13 

22 

23 
17 
11 


5 
24 
19 

8 
16 

7 

3 
20 

IS 

22 

17 

4 


10 
23 

5 

4 
19 
12.5 

2 

12. S 

7-5 
21 

25 
22 


7 
16.5 
27 
11 

4 

6 

20. s 
16.5 
24 
26 
14 

3 

20.5 
18 
14 


IS 

16.5 

27 

6 

2 

3 

14 
I9S 

2S 
24 
22 

5 

16.5 

22 

9-5 


W 

X 

Y 


17 
7 
11 
21 
23 


25 
20 

14 
21 

17 


Z 

IT 


4 
21 


15 
21 


14 
11 


20 
3 



attempted") and accuracy (represented by "number of problems 
right") will be evident to the reader. The schools ranking high 
in speed are very generally the schools ranking high in accuracy. 
In Test V, which we will take at random, the footrule correlation 
gives R=o.7o or r=o.8o by Spearman's transmutation formula. 
By supplying the detailed data in Table V we do not need to dis- 
cuss the material in detail here. The conclusion is clear that speed 
and accuracy in these formal operations go hand in hand. 

We feel that this point is of great importance in the methodology 
of teaching. From individual experimentation in the classroom, 
the writers are convinced that speeding up class work conduces to 
greater accuracy in the manipulation of formal operations. The 
results of testing pupils in 27 schools confirm our classroom 
experience. 

Thus the teaching program that we would lay before teachers 
is contributed to by the findings of the last sections: First, drill 
pupils daily in the formal operations by stressing the most difficult 
and the most important processes. (As a result of our investigation 
we know the most difficult processes, and they will be taken up 
in the next section. We do not know the most important processes 
however. The Illinois Committee on Standards has set as one 
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of its tasks for the next year of research the determination of the 
answer to this question.) Secondly, drill pupils under "time con- 
ditions." // should be made "second nature" to manipulate the 
different formal operations under the pressure of "time." Life situa- 
tions continually demand it — the school should constantly prepare 
for it. Again classroom experimentation of blackboard and seat 
work done by the writers leads to this conclusion. 

At this point let us call to mind the steps of our general program. 
We have stated the aim and outcome of teaching algebra; classified 
the content carefully into fundamental operations and types of 
problems; designed tests for each fundamental operation and for 
verbal problems, establishing definitely our principles of design 
and procedure; given the tests to large groups of pupils; set up 
tentative standards of speed and accuracy for each operation and 
made it possible to compare the practice and efficiency of a teacher 
or a school with the efficiency of the "best schools"; discussed 
the "yardstick" function of tests, the relation between formal 
efficiency and reasoning ability, and the relation between speed 
and accuracy. 

4. THE CHIEF FUNCTION OF STANDARDIZED TESTS IN FIRST- YEAR ALGEBRA: 

DIAGNOSIS 

We said that tests have two functions: (1) measurement of 
abilities in order to establish norms and compare attainments; 
(2) diagnosis of difficulties of individual pupils. The greater of 
these two functions is the latter. 

We are primarily interested in ways and means of improving 
instruction in first-year algebra — only incidentally interested in 
establishing standards or norms of attainment. The norm of 
attainment is of value only as it spurs the teacher to a high stand- 
ard of class- teaching; the test is of value only as it points out 
principal typical difficulties that pupils face in learning algebra. 
If it is properly designed, that is, if it measures specific processes, 
it can be made to do this. 

Pupils' errors in first-year algebra. — Pupils make two principal 
kinds of errors: (1) accidental errors (i.e., errors of reading, writing, 
following directions, arithmetic, etc.), and (2) recurring errors. 
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Recurring errors supply a means of determining exactly which 
types of problems, operations, or processes pupils have not mastered 
provided the tests are rigidly designed on the "cycle" or "rotation" 
principle. Thus, in diagnosing difficulties in "learning," it is the 
recurring errors that are significant. They reveal which types of 
operation have not been mastered. The Standardized Tests sub- 
mitted herewith, designed as they are on the principle of recurring 
types of operation reveal exactly which are the typical difficulties 
pupils face. 

Table VI gives a complete list of recurring errors made by 
ioo pupils on each of the n formal operations, together with the 
frequency of occurrence and the percentage that the recurring 
errors of each particular type are of all recurring errors made. 

This list is complete for the pupils whose work was studied. 
It has been compiled by the writers of this report, who scored and 
judged carefully every problem on each of the n tests for each 
pupil. In many cases the combined judgment of the two writers 
was made on particular errors. The list can be used by teachers as 
a definite guide to help eliminate these particular errors on the part 
of their pupils. Knowledge as to which are the most difficult 
operations will lead to wise methods of eliminating the errors in 
such operations. 

Let us summarize the outstanding facts concerning the recurring 
errors made on formal operations. 

Test I. Removal of parentheses. — A fairly high degree of effi- 
ciency was maintained. Of the mistakes that were made, one-half 
were in the use of signs. Of these, twice as many were made when 
the — sign was used outside the parentheses as when the — sign 
precedes the first letter inside (with + sign outside). (The 
writers' drill exercises take account of this.) One-sixth of all 
pupils make an arithmetic mistake on this problem. 

Test II. Special products. — One-fourth of all recurring mis- 
takes are on cross-products. This is also confirmed by predomi- 
nance of error No. 14 in Test IV. A very large group of pupils fail 
to square the literal factor when the exponent is greater than 1, 
and another considerable group use the product of two numbers 
instead of twice the product. 
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TABLE VI 

Complete List of "Recurring Errors" for Each Test, Together with 
Frequency and Percentage of Occurrence 

Each error in this list has occurred more than once upon the paper of some 
pupil. The numbers in the first column opposite each error, indicate the number of 
pupils [out of a "random selection" of 100] who made that particular error one or 
more times in the test. The numbers in the second column indicate the percentage 
of all pupils who make "recurring errors," who made that particular error. 



No. of Error 



Tests 



No. Pupils Mak 

ing Error One or 

More Times 



II 

Percentage of 

All " Recurring 

Errors" 



I 

8 

16 



11 
12 



TEST I 

Arithmetic errors: 24-8 = 182; i8-o=i8... 
Omission of symbols, signs, or terms: 

6( 3 z+8) = 18+48 

Errors of reading or writing: (23;— 3)*= 

\f—\ix-\-<) 

Errors in use of signs in multiplication 

a) Minus sign preceding ():— 4(3*— 4) = 

— 12X— 16 

b) Minus sign preceding first term within 

(): a(-7*-i)=63*-a 



IS 
6 



TEST II 

Arithmetic errors 

Omission of symbols, signs, or terms 

Errors in use of signs in multiplication . . . 

Errors in use of signs in addition: 

(x+3){x—4)=x'+x—j2 

Errors in cross-products: (a— 4)(a+s) = 

a 2 — 20 

(Note. — It may be due to carrying over 

rule for product of sum and difference; made 

by pupils who got product of sum and differ 

ence correctly.) 

Use of product of two numbers instead of 
twice the product: (23;— 3)*=4x*— 6x+g 

Inability in specific operation tested 

Failure to square literal factor with expo- 
nent greater than 1: (a?+3)(a*— $)=a 2 — 9 

test in 

Arithmetic errors 

Inability to grasp principle of substitution. 
Squaring product of literal factor instead of 

the one designated: ab' = (3- 2)* =36 if 

0=3,6 = 2 

Using exponent as coefficient and vice versa: 

a; 3 = io if x=5 

Adding factors instead of multiplying them: 

3*y=3+5+2 if x = 5,y=2 



14 
7 

S 

1 

10 

2 

20 



9 

IS 

13 



35-7 
14-3 



33-3 
16.7 

6.6 

i-3 

13-4 

2.6 
26.7 



12.0 
20.0 



17.4 



33 


47.8 


3 


4-4 


22 


31-8 


2 


2.9 


9 


131 
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No." of .Error 



Tests 



No. Pupils Mak- 
ing Error One or 
More Times 



II 

Percentage of 

All "Recurring 

Errors" 



2 
3 
4 
8 
13 

14 



15 

16 
17 



1 

la 
3 
4 
5 
8 
18 



19 

20 
22 

23 



1 

3 

8 

25 



TEST rv 

Omission of factors 

Errors in writing 

Errors in use of signs in multiplication 

Positive inability to factor 

Incorrect division by monomial factor: 
Sx'+isx> = s&(3x) 

Factors such that the sum of the cross- 
products are incorrect: 52?+ 162+3 = 

(S*+3)(*+i) 

Factors give correct first and second term, 

but incorrect third: <i 2 +ioa+24 = 

(a+8)(a+2) 

Failure to recognize monomial factor: 

6a 3 +oa' = (2a+3)(3a+3a J ) 

Failure to get highest monomial factor: 

i2y+i8y 4 =2(y+9y') 



test v 

Arithmetic errors 

Arithmetic error of this type : — n • o = » 

Error in writing 

Errors in use of signs in multiplication 

Errors in use of signs in addition 

Inability in specific operation tested 

Failed to change signs if numerator preceded 

. 4#— 2 x—3 , 

by — sign: — - =0; i6z— 8— 

3 4 



3*— 9=° 

Multiplied only one side of equation by 

L.C.M.: ^+^=5; 3*+6*=5 

4 2 
Error in use of sign in transposition : 3*+ 2 = 

6; 3*=6+2 

Error in division (result inverted, e.g., 13* 



"'"=?) 



Multiplied numerator by L.C.D. (e.g., 

2 ■! 
7— =0; 4— 2X— 20+sa; 3 =o) 

2—X 2+X ' * ° 

TEST VI 

Arithmetic errors 

Error in writing 

Inability in specific operation tested 

Incorrect use of exponents in multiplication 

a) Multiplying exponents instead of add- 
ing them: o'-o 5 =a IS 

b) Subtracting exponents instead of add- 
ing them: x 1 -x=x 6 

c) Failure to add x 7 -x=x' 1 



4 
7 

2 

37 



4 
14 

s 



28 

8 

3 

4 

28 

27 



27 

16 

4 



11 

6 

21 



43 
7-4 

2.1 

39-4 

1 . 1 



21.3 

4-3 
14.8 

S-3 



18.4 

5-2 
i-9 
2.6 

18.3 
17.7 



17.7 

i°-5 
2.6 

.6 

4-6 



8.0 

4-4 

15-3 

6-5 

2-9 
0.7 
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No. of Error 



Tests 



No. Pupils Mak' 

ing Error One or 

More Times 



II 

Percentage of 

All "Recurring 

Errors" 



26 



27 



8 

28a 
b 

14 



29 

3° 
31 



1 
8 

24 
32 

33 



34 
35 
36 



TEST VI— Continued 
Incorrect use of exponents in involution 

a) Adding instead of multiplying: {x i Y=x 1 

b) Subtracting instead of multiplying: 
(x>)< = x 

c) Dividing instead of multiplying: 
(*»)«=«* 

d) Raising to a power instead of multiply 
ing: (x')*=x 9 

e) Failure to raise all possible factors to 
required power: (ab') 2 = (ab*) 

Incorrect use of exponents in division 

c 3 

a) Adding instead of subtracting: — =c s . . 

b) Multiplying instead of subtracting: 



- =y » 



test vn 

Inability in specific operation tested 

Find only one root: x 2 — 81=0; s=o.... 
One root correct; other incorrect: y*-f-y=6; 

y=— 3 or —2 

Incorrect solution due to: factors such that 

sum of cross-products is incorrect: 

n 2 — 7» = i2; »=6or2 

Incomplete, e.g., x'— 81= , *— 9=0, 

a;+9=o 

Incorrect use of formula method of solution 
Solution by factoring left member; right 

member not o: n 1 — yn= 12, n(n—y) = 12. 

TEST IX 

Arithmetic error 

Inability in specific operation tested 

Incomplete: V / 8 = V / 4X> / 2 

Left factor_of same power as degree of radi- 
cal: /32 = 2V / 8; VHJib~* = b*V& 

Error in factoring; perfect square factorcor- 
rect, other incorrect: V 32= 4V 4; V5o = 

5^5 

Does not multiply numerator by rationaliz- 
ing factor: V % =iv 3 

Failed to take square_root although factor- 
ing correctly: V xSy > =x*y > V / x 

Factored correctly, took square root cor- 
rectly; p lace d r adica l sign over wrong 
factor: Va^b* = Va 2 ¥-a 



45 

1 

3 
18 
16 



32 
28 



7i 

9 

5 



14 
88 



23 

4 

8 



32-4 
0.7 
2.2 

131 

11. 6 

0.7 

i-5 

21.6 
19.0 

1-3 

48.0 

6.0 
3-4 

0.7 



9-7 
60.6 

14 



iS-9 

2.8 
5-5 
14 

2.8 
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No. of Error 



Tests 



No. Pupils Mak- 
ing Error One or 
More Times 



II 

Percentage of 

All "Recurring 

Errors" 



20 

22 



24 

37 
38 



39 



40 



1 

ia 

3 
8 

!9 
20 

23 

24 
4i 



42 
43 

44 



TEST X 

Error in writing. 

Inability in specific operation tested 

Errors in use of signs in transposition 

Error in division, result inverted: e.g., V= 

Iwh, i"—^ 

Incomplete 

Transposing factors instead of terms: V= 

Lwh; w—V—Lh 

Interchanged factors of both sides of equa- 
_ PL _ EL 

tion: E=~; P=-^ 

Error in selecting coefficient of the unknown 

in L= — — - , M =- — (considers (t—g) as 
t t g 

coefficient of M) 

Divides a term of numerator by the denomi- 

r Mt-g ,, 
nator: e.g., L = — —^-—M—g 

TEST XI 

Arithmetic errors: 3-21 = 73 

Arithmetic errors of the type n-o=o 

Errors in writing 

Inability in specific operation tested 

Multiply only one side of equation by L.C.M 

Error in use of signs in transposition: 
6x— 4=10; 6z = 6 

Multiply numerator by denominator in clear- 
ing fraction 

Incomplete (e.g., — y= — 3) 

Errors in use of signs in subtraction: 

\io*+6;y=78 ' W ° 3 

Errors in use of signs in division : — 1 2X = 24 ; 

X—2 

Adds left member, subtracts right member 

[4^4-2^ = 20 
or vice versa: i 4 * ' ■? ■ ■jx=iq . . 

Adds corresponding members when he should 

subtract: {^ +I °?1 54; 7 q = 5 2 

\ 2 P— 37 = 2 ' '* J 



4 
12 

4 

44 

I 



3° 



2-5 

75 
2.5 

27-3 
0.6 

7-5 
18.6 



Si 


316 


3 


1.9 


25 

1 
4 
3 
2 


So 
2 
8 
6 
4 


3 


6 


1 


2 


2 


4 



We may dispose once for all, of the error marked No. 8 
in each test, "positive inability in the specific operation 
tested." 
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We give below the percentage of all errors that were made, 
which show inability to use the operation in question in each 
test. 



Tests 


Percentage 


Tests 


Percentage 


2 


20 


7 


21.6 


3 


4-4 


9 


60.6 


4 


39-4 


10 


75 


5 

6 


17-7 

15-3 


II 


6 







This table reveals that there is a very large number of our pupils 
that are absolutely unable to handle certain combinations of the 
following operations: special products, factoring (complete quad- 
ratic), fractions, exponents, quadratics, and radicals. This per- 
centage, it should be noted, may be deceptive, for in some cases 
it includes only a small proportion of all errors made. It is strik- 
ing at least as showing the cases in which positive inability to do 
the problems stood out. 

Test III. Substitution. — Relatively few errors. Of those that 
were made, nearly one-third are due to " squaring product of literal 
factors instead of one designated." Practically half of all errors 
are arithmetic. 

Test IV. Factoring. — Thirty-nine per cent of all recurring 
errors show positive inability to factor particular types of factoring 
problem (mostly complete quadratics). The outstanding errors 
are found to be error numbers 14, "factors such that sum of cross- 
products is incorrect," and 16, "failure to recognize monomial 
factor." 

Test V. Errors in the use of signs again predominate, e.g., 
in addition and in multiplication failure to change signs if numerator 
is preceded by — sign. Also need for emphasis on multiplying 
both sides of equation by L.C.M. 

Test VI. There are three outstanding errors in the use of 
exponents — incorrect use in involution (adding instead of multi- 
plying, raising to power instead of multiplying, and failure to raise 
to required power). There are other scattering errors which recur 
rather frequently. 
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Test VII. Pupils are prone to find only one root. Their most 
outstanding mistake again is in cross-products — getting factors 
such that sum of cross-products is incorrect. 

Test IX. Sixty per cent of all recurring errors show positive 
inability to handle particular kinds of radicals, e.g., of the type 



V 



especially. Of the other recurring errors, pupils commonly 

leave factor of same power as degree of radical. They also do not 

multiply numerator by rationalizing factor. 

Test X. Three typical recurring mistakes: (i) errors in divi- 

hl 
sion, results inverted, e.g., in v=lwh, w=—; (2) interchanging 

both sides of the equation; (3) errors in selecting coefficient of 

the unknown, e.g., in L= — ; — , M=- — , pupil considers (t—g) 

1 1 g 

as coefficient of M. 

Test XL Aside from purely arithmetic errors, the solution of 
simultaneous equations of the type represented here has been rather 
well automatized. Errors in use of signs stand out again. We 
would like to call particular attention to the frequency of recurrence 
of errors in the use of signs in all tests where they are possible. 

Methods of "differentiated" drill will improve instruction in the 
formal processes. — The giving of standard tests is only a first step 
in the program of improving instruction. The tests, however, if 
corrected by the teacher will lead to definite knowledge as to the 
types of problems upon which she needs to drill her pupils. Great 
insight can be obtained by the teacher into the difficulties of her 
pupils if she will take the trouble to examine the tests carefully 
and classify the mistakes made. Typical recurring ones will stand 
out clearly and these she can drill upon in a differentiated way. 

The working out and giving of the Standardized Tests have 
offered the writers an opportunity to extend their service to teachers 
of algebra with a thoroughgoing and complete classification of the 
recurring errors made by pupils. The tabulation and discovery 
of errors are being followed up by the careful design of drill exer- 
cises to aid in the elimination of the weaknesses in learning. This 
in turn is being supplemented by thorough experimentation to 
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determine the frequency with which particular operations should 
be drilled, the distribution of the different types of arrangement 
in the different exercises, best ways of presenting material, etc. 
Thus the fifth step in our program has just been taken. 

We are now organizing a thoroughgoing experiment in the 
Parker High School, Chicago, and in a group of co-operating high 
schools in and about Chicago, in the attempt to do the things out- 
lined above. Practice exercises have been organized in a tentative 
way, separate exercises for each operation. 1 Those exercises have 
emphasized the most frequently recurring errors roughly in propor- 
tion to their difficulty. 

From this point on real progress in improving algebra instruction 
can be made only by teachers of the subject working in their class- 
rooms. We urge, therefore, the undertaking of a very thorough 
co-operative experiment by teachers of algebra along the lines 
marked out by this report. We wish to enlist the co-operation 
of all teachers interested in the attempt to improve the teach- 
ing of algebra along the lines suggested herewith. A definitely 
worked out experimental plan of trying out various ways of teach- 
ing algebra will be mailed to anyone interested enough to take 
part in a co-operative way. Complete records of the conduct of 
the experimental work will be kept and reported in the pages of 
this journal next year. 

1 Sample sets of practice exercises with prices may be secured from H. O. Rugg, 
School of Education, University of Chicago. They will be sold at the cost of publi- 
cation and handling. 



